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IMPROVEMENTS RELATING TO IMAGE PROCESSING 



The present invention relates to a method and system for image processing, for 
particular, but not exclusive, use in the colour matching of articles such as dental 
5 prostheses, textiles^ paints, dyes, car body repairs, picture restoration and in the 
cosmetics industry. In addition, the present invention may be used in the colour 
identification of the colours of precious metals^ gems and stones and for use in the 
printing and security industries. 

10 It is known from the prior art to colour match a variety of objects simply by eye and 
to compare the colour with a reference colour guide. The colour guide is usually held 
in proximity to the test object for a direct comparison. This is a purely subjective 

_ evaluation and can lead to a colour mismatch since one person's assessment may 
differ from another's. Moreover, the perception of colour is dependent on a number 
15 of factors such as the background lighting conditions and texture of the object itself. 
An object with a pitted surface may, if viewed in one direction, cast shadows on its 
own surface thus distorting the overall colour of the object. Alternatively, a smooth 
shiny object can reflect light from its sxrface leading to bright spots similar colour 
distortions. 

20 

In the restoration or replacement of a tooth or set of teeth, it is important accurately to 
select the correct tooth colour so as to match^ not only the adjacent tooth in colour 
and shape, but to match the entire set of teeth in overall colour harmony and surface 
contour profile. However, it is difficult to critically assess highly reflective surfaces 

25 such as the enamel of teeth. It is known from the prior art to quantify the colour of 
teeth by manually comparing a patient's natural teeth with a set of "shade guides". 
These guides typically comprise a row of substantially flat^ plastic tooth shaped items 
mounted on a board in ascending grades of shades. The first step in the colour 
determination process is made subjectively by the dentist or dental technician, by 

30 holding the shade guide next to the patient' s own natural teeth and attempting to find 
the best match. This can be problematic because tooth colour is affected not only by 
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25 



ambient light colour/intensity in the surgery i.e. fluorescent or natural light, but also 

^by„the„surrounding^colour-of-the-patient-'s own cJothing or-make-up/complexion- In 

addition this step is dependent on the visual acuity and experience of the dentist or 
dental technician. 

Once the dentist or dental technician has made his/her choice of best match colour 
from the shade guide the next step in the process is to relay the information to a 
dental laboratory technician who then constructs the dental prosthesis, typically from 
a set of pre-coloured components. The information he/she may receive is that the 
dental prosthesis required is a mix between two or more of the shades on the guide. 
In this step of the overall process, there is a dependency on a yet further subjective 
colour assessment by the dental laboratoiy technician when mixing appropriate ratios 
j?f_the pre-cp|pured .components the - 

finished product is then returned to the dentist for fitting into a patient *s mouth. It is 
only after the dental prosthesis has been constructed that it becomes apparent if the 
colour match was accurately evaluated by the dentist or dental technician and 
subsequently constructed by the dental laboratory technician. It will be appreciated 
this process often results in unacceptable levels of colour mismatching so that a 
second or replacement dental prosthesis needs to be constructed at a substantial cost 
and inconvenience to the patient, dental professional and dental prosthesis 
manufacturer. 

Methods which have been attempted to try to minimise human error when assessing 
tooth colour include: 

• illuminating the patient's mouth in a controlled manner and comparing the 
natural teeth to a reference shade guide set illuminated under similar conditions. 
The problem with this method is that it does not completely eliminate variations 
in ambient lighting conditions. 



2 
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• photographing the patient's mouth with a reference shade guide in the frame. 

-T^e-problem withthis method- is thatthe equipment canbe' bulky 'and that " the 

colour in the photograph may be distorted and/or misrepresented through the 
process of developing and producing the photograph. In addition, the flash from 
the camera causes high levels of reflection from the tooth surface. 



• videoing the patient's mouth with a reference shade guide in the frame. The 
problem with this method is that the equipment can be bulky and that the colour 
in the video may not be accurate. 

10 

• manually drawing and painting/colouring an artist's impression of a tooth. The 
problem with this is that it can be expensive, time consuming, and it is not 

independent of ambient lighting conditions. - - - 

15 None of the prior art methods is capable of capturing an exact colour image of a 
natural tooth. This is partly because of the inherent properties of teeth themselves. 
Natural teeth are curved, not uniformly smooth and the colour distribution of the 
tooth is not even or uniformly distributed throughout the tooth. Natural teeth are 
trarislucent on their surface, the transparencies of dentine and enamel are difficult to 

20 correct for when representing the colour of a tooth. Teeth are light reflective which 
results in bright spots and bright lines. All of these factors contribute to the difficulty 
in accurately capturing a colour image of a tooth. 



A problem not addressed by any of the prior art methods is the subjective colour 
25 assessment which the dental laboratory technician has to make when given a recipe 
or image to work to, so as to construct the dental prosthesis. Some methods have 
made improvements in the standardisation of assessing the colour of the patient's 
tooth in the first instance, but problems remain with human errors in constructing and 
colour matching the prosthesis to a recipe. 

30 
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A method of accurate colour image capture and construction of a prosthesis to that 
colourjvould.ofifer iinmediate advantage over the prior art. — — — ~ 



(i) According to a first aspect of the invention there is provided a method 
5 of image processing on a computer, comprising the steps of: 

(ii) importing a digital image of an article, the image further including a 
representation of a reference object having a predetemained colour; 

(iii) colour-correcting the digital image on the basis of the reference object 
so as to generate a true-colour digital image; 

JO (iv) selecting at least a portion of the true-colour digital image containing 

a representation of the article; 

(v) determining true-colour attributes of pixels within the selected portion 
of the true-colour digital image; _ _ 

(vi) generating a second digital image corresponding to the selected 
1^ portion of the true-colour digital image, but replacing true-colom: 

attributes of each pixel with colour attributes selected ftom a database 
of predetermined colour attributes, for each pixel selecting 
predetermined colour attributes from the database closest to the tme- 
colour attributes as determined by a predetermined algorithm; and 
20 (vii) generating a third digital image corresponding to the second digital 

image, but replacing the colour attributes selected from the database 
for each pixel with mutually distinguishable false-colour attributes so 
as to form a contour image clearly distinguishing respective sets of 
pixels sharing the same predetermined colour attributes, 

25 

According to a second aspect of the present invention there is provided an image 
processing system, the system comprising a computer and: 

(i) means for importing a digital image of an article, the image ftnther 
including a representation of a reference object having a 
3 0 predetermined colour; 
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(ii) means for colour-correcting the digital image on the basis of the 

. , reference-object so as to generate a true-colour digital is — '■ 

(iii) means for selecting at least a portion of the true-colour digital image 
containing a representation of the article; 

5 (iv) means for determining true-colour attributes of pixels within the 

selected portion of the true-colour digital image; 
(v) means for generating a second digital image corresponding to the 
selected portion of the true-colour digital image, but replacing true- 
colour attributes of each pixel with colour attributes selected from a 
10 database of predetermined colour attributes, for each pixel selecting 

predetermined colour attributes from the database closest to the true- 
colour attributes as determined by a predetermined algorithm; and 

- (vi) ^ means for.generating a third digital image-corresponding to the second 

digital image, but replacing the colour attributes selected from the 
15 database for each pixel with mutually distinguishable false-colour 

attributes so as to form a contour image clearly distinguishing 
respective sets of pixels sharing the same predetermined colour 
attributes. 

20 According to a third aspect of the present invention, there is provided a computer 
program product for processing an image^ the computer program product being 
operable, when installed on a computer, to: 

(i) import a digital image of an article, the image further including a 
representation of a reference object having a predetermined colour; 

(ii) colour-correct the digital image on the basts of the reference object so 
as to generate a true-colour digital image; 

(iii) select at least a portion of the true-colour digital image containing a 
representation of the article; 

(iv) determine true-colour attributes of pixels within the selected portion 
of the true-colour digital image; 



25 



30 
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(v) generate a second digital image corresponding to the selected portion 
of the true-colour digital-image^but replacing tme -colour-attributes of- 

each pixel with colour attributes selected firora a database of 
predetermined colour attributes^ for each pixel selecting 
5 predetermined colour attributes jfrom the database closest to the true- 

colour attributes as determined by a predetermined algorithm; and 

(vi) generate a third digital image corresponding to the second digital 
image, but replacing the colour attributes selected from the database 
for each pixel with mutually distinguishable false-colour attributes so 

10 as to form a contour image clearly distinguishing respective sets of 

pixels sharing the same predetermined colour attributes. 

. The computer program product of .the third-aspect of the present invention raay.be a 
computer program in any suitable format, including object code, source code or a 
15 data storage medium on which the computer program is stored. 

Preferably, the second and third digital images are displayed together on a monitor 
device or colour printout. Advantageously, there is also displayed a key comprising 
the false-colour attributes and their corresponding predetermined colour attributes, 
20 optionally including identification data relating to the predetermined colour 
attributes^ RGB component values for the predetermined colour attributes, and/or 
data relating to a percentage composition of pixels sharing the same predetermined 
colour attributes within the second image. 

25 Preferably, the digital image of the article is captured directly with a digital camera, 
the camera advantageously being provided with cross-polarised filtration. Typically 
this is achieved by a pair of cross-polarised filters^, preferably the iiltere are grey so as 
provide a minimal colour temperature shift whilst simultaneously providing good 
transmission. The effect of cross-polarised photography is to control reflections, 

30 lustre and to cut out glare. 

6 
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Preferably, the camera is pre-set and/or pre-programmed to a specified focal length. 

^For exainplerthe focaHength may be-25-±-2-cm~It is d — 

deviations in focal length so as to minimise errors that may occur by virtue of 
variations in, or non-uniform, illumination. 

5 

The reference object referred to in step (i) above generally comprises a reference 
colour indicator placed in close proximity to the article or associated with the 
camera's visual field so that the captured image contains a reference colour, 

10 Preferably, the reference colour is grey and more preferably still the grey is cool grey 
C pantone number 8. The reference indicator may take the form of a substantially U 
or L shaped block- The reference indicator may also be labelled so that the image of 
the object can -easily be identified or-cross referenced. 

15 The reference object of known colour allows the digital image to be colour-corrected 
in a known manner in step (ii) above so as to generate the true-colour digital image. 

In step (iii), a portion of the true-colour digital image is selected in a known manner, 
the selection comprising, for example, an image of a single tooth. 

20 

True-colour attribxites of each pixel in the selection may be determined in step (iv) in 
a known manner by, for example^ scarming through the tme-colour digital image in a 
raster manner. 

25 The database of predetermined colour anributes will generally contain fewer discrete 
attributes than are present within the true-colour digital image. In a particularly 
preferred application of the present invention, which is to generate dental prostheses 
firom ceramics or the like of known colours so as closely to match a patient's natural 
tooth colours, the database will contain the colour attributes of a range of available 

30 ceramics materials or the like. The database may contain several subsets of ceramics 
colours corresponding to the ranges of colours offered by different ceramics 

7 
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manufacturers. At present, most manufacturers of ceramics for use in dental 

prostheses ofifer one or-more discrete ranges of atout"sixteen"subtly"diflferent sKades. 

Hitherto, dental prostheses have been made using a single, shade or colour of ceramic 
which has been subjectively judged to be the closest match to a patient's existing 
5 tooth or teeth. However, by way of the present invention, it is possible to determine 
shade variations within a single tooth and to replicate these shade variations in a 
prosthesis by selecting the closest match from the predetermined range of ceramics 
colours for individual areas of the tooth, and then to construct a prosthesis by 
painting or otherwise, applying different shades of ceramics to a base prosthesis so as 
1 0 broadly to match the colour variations in the natural tooth. This is a significant 
advantage over the prior art. 

- - The predetermined-algorithm used-to-sclect the predetermined -colour attributes for 
each pixel in the second digital image from the database, based on the true-colour 
1 5 attributes of each corresponding pixel in the true-colotu: digital image, may be any 
appropriate algorithm which will be known to a person of ordinary skill in the art. A 
currently preferred algorithm uses octree quantisation, but other standard techniques 
may also be used. It will be appreciated that the predetermined algorithm is in effect 
an image compression algorithm which creates an internal paiette from the 

20 predetermined colour attributes in the database and then applies these to the second 
digital image so as to match, as closely as possible, the true-colour attributes in the 
true-colour digital image. For example, where the true-colour digital image contains 
a range of 256 colour attributes, the predetermined algorithm is used to compress 
these to the 16 colour attributes forming the internal palette made up of the available 

25 colours of the predetermined range of ceramics colours within a subset of the 
database, for each pixel selecting a ceramics colour attribute from the database 
closest to the true-colour attribute of the corresponding pixel in the true-colour digital 
image. 

30 In step (v5) above, the third digital image may be generated by determining a range 
key value for each pixel In the second digital image and then representing this range 
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key value at corresponding pixels in the third digital image with mutually 

distinguishable colour attributes on_ a , .pixel-by-pixel_ .basis. In a-^preferred 

embodimeat, the range key value for each, pixel in the second digital image is 
determined by dividing the red component value by 1 6 and determining the integer 
5 part thereof, the green component value by 16 and detennining the integer part 
thereof, and the blue component value by 16 and determining the integer part thereof. 
The range key values in this embodiment will therefore be 0 for component values 0 
to 15, 1 for component values of 16 to 31, 2 for component values of 32 to 47, 3 for 
component values of 48 to 63 and so forth. Each range key value is then assigned a 

10 mutually distinguishable colour, preferably a vivid colour, in a manner known in the 
art, and a false-colour third digital image is then generated accordingly. The third 
digital image thus gives a clear indication as to which regions of the article, say a 
tooth, are to be represented by a particular colour selected from the palette available 
from the database. In other words, the degree of colour quantisation in the third 

1 5 digital image is the same as in the second digital image, but with the subtle colour 
diiferences between the colours from the palette of available ceramics colours being 
emphasised by using false colours. The third digital image, or contour image, may 
then be used as a guide by, say, a dental laboratory technician to assist in 
manufacturing a dental prosthesis by selecting the ceramic shades corresponding to 

20 the false-colour representations and then painting these onto a base prosthesis in 
accordance with the contour map of the third digital image. 

In order to assist the dental technician, it is preferred that the method of the present 
invention is arranged to generate a display, for example on a computer display or a 

25 colour printout, showing both the second and the third digital images, together with a 
key showing the various ceramics colours from the database and their associated 
false colours in the third digital image. They key may comprise first and second rows 
of coloured rectangles, the first row showing the available ceramics colours and the 
second row showing the corresponding false colours in jxixtaposition thereto, Tlie 

30 key may optionally include identification data relating to the predetermined ceramics 
colours, RGB component values for the predetermined ceramics colours, and/or data 
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relating to a percentage composition of pixels sharing the same predetermined 
-ceramics colours within the"second image. " 



The key may be generated by building an internal array containing data relating to 
5 each pixel in the second digital image. For each pixel, the internal array may contain 
data fields giving the original pixel colour, the red component, the green component, 
the blue component, the range key value and a count of pixels having that range key 
value. For any particular pixel, if its range key value does not yet exist as the 
internal array is being built, then a new element is created in the array. If, however, 

1 0 the range key value does already exist, then the count of pixels having that range key 
value is increased by one. Once the internal array has been built, an external table is 
constructed in an SQL compliant database having the same structure as the internal 

array, and the-exteriial table;is-then populated with the contents of the internal array. 

Stored SQL procedures may then be used in a known manner to determine, in the 

15 SQL compliant database, the dominant (most frequently occurring) original pixel 
value in each range key and then to create a corresponding internal array (key array), 
Then, for each element in the key array, a vivid colour rectangle may be drawn as a 
key undemeath the thurd digital image and identified with a shade relevant to that key 
colour. 

20 

In use, embodiments of the present invention allow a user to take a photograph of an 
article, for example a piece of coloured textile and to relay information relating to the 
photograph to a place remote from wiiere the textile actually is, for example a paint 
factory. An operator in the paint factory then initiates a software program \o analyse 
25 the colour values from which a recipe can be generated so that a replica of the colour 
of the textile can be reconstituted from various ratios of different dyes. 

Preferably, embodiments of the invention are used for colour matching a natural 
tooth or set of teeth so that a dental prosthesis can be constmcted to match the natural 
30 tooth or teeth of a patient. 



10 
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Reference herein to a dental prosthesis is intended to include crowns, dentures, caps 

and-any- other, dental product-whieh i s intended to replace or foixa part of a patienf s 

set of teeth. 

5 Embodiments of the present invention need not be limited to use in the manufacture 
of dental prostheses, but may be used for colour matching of textiles, paints, dyes, car 
body parts, pigments in picture restoration and cosmetics such as hair dyes or skin 
preparations, among other applications. 

10 It will be appreciated that embodiments of the present invention may also be used to 
monitor colour deterioration over time of, for example, textiles or paintings by 
comparing colour values against each other over time. Additionally, embodijients of 

. - - . rti.e_present invention may _be used. to. .monitor colour-standards during- industrial 

processes such as car and/or textile manufacture. 

15 

For a better understanding of the present invention and to show how it may be carried 
into effect, reference shall now be made by way of example to the accompanying 
drawings, in which; 

20 FIGURE 1 shows a schematic flow diagram of a method of colour matching using an 
embodiment of the present invention; 

FIGURE 2 shows a schematic flow diagram illustrating the use of an embodiment of 
the present invention; 

25 

FIGURE 3 shows a colour analysis of a tooth, using an embodiment of the present 
invention; 

FIGURE 4 shows a digital image including a colour reference indicator in S2tu in a 
30 patient's mouth; and 
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FIGURE 5 is a flow chart setting out the steps involved in an embodiment of the 
—present invention. — 



With reference to Figure 1 there is shown a flow diagram of the steps of a method of 
5 colour niatching/identification of an object using an embodiment of the present 
invention. The first step of the method is to capture an image of an object which it is 
desired to colour match and/or colour identify. This is achieved by first illuminating 
the object with an appropriate light source and taking at least one photograph of it 
with a digital camera fitted with cross-polarised filtration. Optionally a colour 
10 reference indicator is included in the captuied image (see Figure 4). The camera can 
be pre-programmed to a specified focal length and arranged to be a selected distance 
away from the object in order to reduce variations in illumination conditions. The 
„ object could.be a.piece.of textile, wall covering, part of a picture which needs to be 
restored or requires the original colour recorded for posterity, a car body part or a 
15 human face for which a suitable cosmetic/hair dye hiie can be matched, area of a 
human body, specimen of ciurency, photograph, precious metal or gem or any other 
article which needs to be colour matched^identified. 



Once the at least one photograph has been taken, information relating to the colour 
20 image can be relayed by an electronic communication system or on a data carrier to a 
site remote fix^m where the at least one photograph was taken. When this 
information is received at the appropriate site, an operator initiates the computer 
program product of an embodiment of the present invention which is capable of 
interpreting the received data and analysing the colour values of the original image, 
25 optionally with respect to the colour reference indicator. Typically the colour values 
are assigned individual bright coloux keys and the analysis proceeds to determine the 
average and most dominant colour value in each area. The coloiir values are 
represented by the intensities of the red, green and blue components of that value. 
Intensity of red, blue and green is selected as these colours are the primary colours of 
30 light Bach image is analysed so that the intensity and relative ratio of each coloux is 
calculated. From the image, colour intensity values are generated so that a replica of 
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. the coloor of the original coloured object can be produced. The computer program is 

also capable of-convertijig-the-values--of-the-redr-green~and-blu6~int^^^^ 

parameters that the operator can reconstitute into colour, for example dye numbers, 
cosmetic colour values and so on. 

5 

The operator can then view the reconstituted image next to the data received for a 
direct comparison. Alternatively, the operator can transmit the information relating 
to the reconstituted image to the location of original object so that a comparison can 
be made between the object itself and flie reconstituted image. This step allows for 
10 quality control. In the instance of providing a colour reference indicator, the whole 
ioiage displayed on a VDU/monitor/screen can be colour corrected/calibrated. 

. ^ - - - It will be appreciated that this provides advantages over-the prior art by reducing the 
level of subjective human assessment of colour matching/idenfification. Moreover, 
15 embodiments of the present invention can be applied to many diverse industries and 
can be used to monitor colour quality control in the paint, dye, car and textile 
industries. It is envisaged that one particular use that will offer improvement over 
current practices is in colour matching original tooth/teeth colour to a dental 
prosthesis. 

20 

With reference to Figure 2 there is shown a schematic flow diagram of the use of an 
embodiment of the present invention for colour matching a deaital crown. In this 
process, the first step is to illuminate the patient's mouth in a controlled marmer with 
a known and reproducible light source. The dentist then takes a photograph of the 
25 patient's mouth with a digital camera fitted with cross-polarised filtration so as to 
produce an image (1). The dentist would typically set the camera a pre-determined 
distance away from the patient with respect to a skeletal reference point such, as the 
bridge of the nose and/or nap of the patient's chin. In this way variations between 
photographs can be reduced. 

30 
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Information relating to the colour of the patieat's original tooth is downloaded from 

the digital -cainera-and~sent via an electromc^ccmmunication"system~si^^ 

Internet or on an electronic data carrier system such as a floppy disc or CD-ROM to 
the dental laboratory. Since this information is confidential, the information would 
5 typically be encrypted for transmission. Once received, the image data is decoded 
and processed by a computer program product of an embodiment of the present 
invention so that a series of red, blue and green intensities (2) corresponding to the 
primary colours of light are produced. The computer program then can calibrate the 
image with respect to a colour reference indicator into constituent colour values (2) 
10 and then into an image (3), and at the same time the program analyses the colour 
values into relative ratios and distribution patterns so as to generate a colour map. 
The map can then be converted into dental laboratory parameters such as porcelain or 
- . --.ceramics colours and so on (4), and the program thereafter provides a recipe (5) from - 
which the dental laboratory technician is able to construct a prosthesis/crovm (6). 

15 

An image (7) of the prosthesis/crown (6) is then subjected to quality control by 
comparing its colour to that of the original natural tooth (8). In the Lnstazice that there 

is a discrepancy in the match of colour between the new crown and the original tooth 
(9) the dental technician can amend the. recipe (5) to compensate for the colour 
20 difference or alternatively request a further original photograph to work from. In this 

way, the colour of the crown can advantageously be checked before it is released to 

the dentist for fitting into a patient's mouth. 

In the instance that the crown colour matches the original natural tootti' (10), the 
25 recipe can be recorded in a central data bank (11) or crown recipe library for future 
reference. Subsequently^ the colour matched crown can he released to the dentist for 
fitting (12) into the patient's mouth. 

With reference to Figure 3 there is shown a computer display of a colour analysis of a 
30 tooth produced by an embodiment of the present invention. The tooth image (13) is 
divided into several areas of similar colour value, each of which is assigned a unique 

14 
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bright colour key thus making them more diatinguishable to the eye as in image (14). 

_The-analysis-procecds to-determme-both-th'e-avefag€^^^ 

value m each area. The colour values are represented by the mtensities of red, green 
and blue components of that value so that a colour map of the tooth can be visualised. 
5 Specifically, image (13) is the second digital image which coixesponds to the selected 
portion of the true-colour digital image of a tooth, but to which an internal palette 
(comprising the colour attributes selected from the database of predetermined colour 
attributes relating to the ceramics colours) has been applied by way of octree 
quantisation. Image (14) is the third digital image which corresponds to the second 
10 digital image (13) but with the predetermined colour attributes having been replaced 
by mutually-distinguishable false-colour attributes for ease of interpretation. Also 
displayed are a key (15) showing the ceramics colours selected from the database and 

^which are-to-be used in making-up a dental prosthesis to match the image (13), and a- 

key (16) showing the corresponding false colours used in the image (14). Also 
15 displayed are at (17) the RGB components of the average original pixel values in 
each range key and at (18) the RGB components of the dominant (most frequently 
occurring) original pixel values in each range key, together with an indication at (19) 
of the percentage composition of each colour within the images (13) and (14), A 
dental technician may then use image (14) and the keys (15) and (16) to create a 
20 dental prosthesis by painting or otherwise applying ceramics materials of the colours 
shown in key (15) onto a base prosthesis (not shown), using image (14) as a clear 
contour guide, thus creating a prosthesis matching the image (13). 



Figure 5 shows a digital image (20) of a patient's mouth, obtained using a digital 
camera (not shown). A reference object (21) having a predetermined colour is 
included in the image (20) so as to enable colour correction of the image. Also 
shown is a selection (22) from the image (20) corresponding to a single tooth. This 
selection (22) is used as the basis for the second (13) and third (14) digital images, 
shown below image (20) in Figure 5, together with the keys (15) and (16). 



15 
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Figure 5 is a flow diagram illustrating an embodiment of the present invention as 
described-hereinbefore. ■■ 

Embodiments of the present invention provide improvements over tbe prior art by 
5 reducing the problems associated with construction of a dental prosthesis and help to 
avoid the situation where it is found that there is a colour mismatch only when the 
prosthesis is constructed and returned to the dentist. Embodiments of the present 
method allow for quality control before release of tbe prosthesis to the dentist. 

1 0 h will also be appreciated that embodiments of the present invention may be of use in 
diagnosmg dermatological lesions and other such conditions where the physical 
appearance and colour of an organ is a relevant diagnostic factor. Embodunents of 

thepresent invention can be used for-capmring images of apart of a body and to relay 

this information to a health care professional remote from the patient so that a 
1 5 diagnosis can be made without the patient needing to be physically present. 



20 
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CLAIMS: 



1. A method of image processing on a computer, comprising the steps of: 

(i) importing a digital image of an article, the image further including a 

5 "P^^se"t^*'°"^farefereDceobjecthavingapredetemimedcolour; 

(ii) colour-correcting the digital image on the basis of the reference object 
so as to generate a true-colour digital image; 

(iii) selecting at least a portion of the true-colour digital image containing 
a representation of the article; 

0^) determining true-colour attributes of pixels within the selected portion 
of the true-colour digital image; 

(v) generating a second digital image corresponding to the selected 
portion of the-true-colour digital -imager but replacing" trSeicoloiir" 

attributes of each pixel with colour attributes selected from a database 
of predetermined colour attributes, for each pixel selecting 
predetermined colour attributes from the database closest to the true- 
colour attributes as determined by a predetermined algorithm; and 

(vi) generating a third digital image coiresponding to the second digital 
image, but replacing the colour attributes selected from the database 
for each pixel with mutually distinguishable false-colour attributes so 
as to form a contour image clearly distinguishing respective sets of 
pixels sharing the same predetermined colour attributes. 

2. A method according to claim 1, wherein the database of predetermined colour 
25 attributes contains fewer discrete colour attributes than arc present in the true-colour 
digital image. 



3. A method according to claim I or 2, wherein the predetermined algorithm in 
step (v) is an octree quantisation algorithm, 

30 
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4. A method according to any preceding claim, wherein the third digital image 

- in step (vi).is.geneTated.by„determining-a-range Jcey-value for-each pixel in the second 

digital image and then representing this range key value at corresponding pixels in 
the third digital image with mutually distinguishable colour attributes on a pixel-by- 
5 pixel basis. 

5. A method according to claim 4, wherein the range key value for each pixel in 
the second digital image is determined by dividing a red component value by 16 and 
determining an integer part thereof, dividing a green component value by 16 and 

10 determining an integer part thereof and dividing a blue component value by 16 and 
determining an integer part thereof 

_ 6. A method according to any preceding okirn, wherein the second and third 

digital images are displayed together on a visual display unit 

15 

7. A method according to any preceding claim, wherein the second and third 
digital images are displayed together on a colour printout 

8. A method according to any preceding claim, wherein the article is a tooth, the 
20 database is a database of ceramics colours or the like used for manufacturing dental 

prostheses, and the third digital image is a template for manufacturing a dental 
prosthesis, 

9. An image processing system, the system comprising a computer and: 

25 (i) means for importing a digital image of an article, die image further 

including a representation of a reference object having a 

predetermined colour; 
(ii) means for colour-correcting the digital image on the basis of the 

reference object so as to generate a true-colour digital image; 
30 (iii) means for selecting at least a portion of the true-colour digital image 

containing a representation of the article; 

IS 
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(iv) means for determining true-colour attributes of pixels within the 
- selected portion-of the true-colour digital image; 

(v) means for generating a second digital image corresponding to the 
selected portion of the true-colour digital image/ but replacing true- 

5 colour attributes of each pixel- with colour attributes selected from a 

database of predetermined colour attributes, for each pixel selecting 
predetermined colour attributes from the database closest to the true- 
colour attributes as determined by a predetermined algorithm; and 

(vi) means for generating a third digital image corresponding to the second 
10 digital image, but replacing the colour attributes selected irom the 

database for each pixel with mutually distinguishable false-colour 
attributes so as to form a contour image clearly distinguishing 

respective sets._of.pixels„ sharing ..the -.same predetermined -colour . . . . 

attributes- 

15 

10. A system as claimed in claim 9, wherein the database of predetermined colour 
attributes contains fewer discrete colour attributes than are present in the true-colour 
digital image. 

20 11. A system as claimed in claim 9 or 10, wherein the predetermined algorithm in 
step (v) is an octree quantisation algorithm. 

12. A system as claimed in any one of claims 9 to 11, wherein the third digital 
image in step (vi) is generated by deteimining a range key value for each pixel in the 

25 second digital image and then representing this range key value at corresponding 
pixels in the third digital image with mutually distinguishable colour attributes on a 
pixel-by-pixel basis. 

13. A system as claimed in claim 12, wherein the range key value for each pixel 
30 in the second digital image is determined by dividing a red component value by 16 

and determining an integer part thereof, dividing a green component value by 1 6 and 

19 
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detemiining an integer part thereof and dividing a blue component value by 16 and 
"determihihg an integer parftlTereof 

14. A system as claimed in any one of claims 9 to 13, wherein the second and 
5 third digital images are displayed together on a visual display \mit, 

15. A system as claimed in any one of claims 9 to 14, wherein the second and 
third digital images are displayed together on a colour printout. 

10 16. A system as claimed in any one of claims 9 to 15, wherein the article is a 
tooth, the database is a database of ceramics colours or the Hke used for 
manufacturing dental prostheses, and the third digital image is a template for 

raanufactuxing a dental prosthesis. " - 



15 17. A computer program product for processing an image, the computer program 
product being operable, when installed on a computer, to: 

(i) import a digital image of an article, the image further including a 
representation of a reference object having a predetermined colour; 

(ii) colour-correct the digital image on the basis of the reference object so 
20 as to generate a true-colour digital image; 

(iii) select at least a portion of the true-colour digital image containing a 
representation of the article; 

(iv) determine true-colour attributes of pixels within the selected portion 
of the true-colour digital image; 

25 (v) generate a second digital image corresponding to the selected portion 

of the true-colour digital image, but replacing true-colour attributes of 
each pixel with colour attributes selected from a database of 
predetermined colour attributes, for each pixel selecting 
predetermined colour attributes from the database closest to the tme- 

30 colour attributes as determined by a predetermined algorithm; and 



20 
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(vi) generate a third digital image corresponding to the second digital 
imagerbut-replacinrtlie-colour atffibitersW^^ from the database 
for each pixel witii mutually distinguishable false-colour attributes so 
as to form a contour image clearly distinguishing respective sets of 
pixels sharing the same predetermined colour attributes. 

18. A product as claimed in claim 17, wherein the database of predetermined 
colour attributes contains fewer discrete colour attributes than are present in the true- 
colour digital image. 

19. A product as claimed in claim 1 7 or 1 8, wherein the predeteimined algorithm 
in step (v) is an octree quantisation algorithm. 

20. A product as claimed in any one of claims 17 to 19, wherein the tliird digital 
image in step (vi) is generated by determining a range key value for each pixel in the 
second digital image and then representing this range key value at corresponding 
pixels in the third digital image with mutuaUy distinguishable colour attributes on a 
pixel-by-pixcl basis. 

20 21. A product as claimed in claim 20, wherein the range key value for each pixel 
in the second digital unage is determined by dividing a red component value by 16 
and determining an integer part thereof, dividing a green component value by 16 and 
determining an integer part thereof and dividing a blue component value by 16 and 
determining an integer part thereof 

25 

22. A product as claimed in any one of claims 17 to 21, wherein the second and 
thurd digital images are displayed together on a visual display unit. 

23. A product as claimed in any one of claims 17 to 22, wherein the second and 
30 diird digital images are displayed together on a colour printout 
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24. A product as claimed in any one of claims 17 to 23, wherein the article is a 
tepJ?*--:fee_database„i 

manufacturing dental prostheses, and the third digital image is a template for 
manufacturing a dental prosthesis. 

5 

25. A method of image processing, substantially as hereinbefore described with 
reference to the accompanying drawings. 

26. An image processing system, substantially as hereinbefore described with 
10 reference to the accompanying drawings. 

27. A computer program product for processing an image, substantially as 
herein before desc ribed with reference to the accompanying drawings. 

15 
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ABSTRACT 

IMPROVEMENTS RELATING TO IMAGE PROCESSING 

A method and system of image processing on a computer, and a computer progiam 
product adapted for image processing, wherein a digital image of an article is 
imported into a computer, the digital image is colour-corrected, an internal palette is 
generated from a database of predetermined colour attributes and applied to the 
colour-corrected digital image so as to generate a second digital image, and wherein a 
third digital image coiresponding to the second digital image is generated, but 
replacing the predetermined colour attributes with vivid coloui attributes. The 
present invention is of particular utility in the manufacture of dental prostheses from 
ceramics materials which substantially match a person' s.natural.tooth colours ... 



Figure 3 
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Figure 1 
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Import and decrypt an 
image of a patient's mouth. 



Draw around the tooth to 
be matched (selection). 



Choose the material 
(ceramic) which will be 
used to create the 
oroslhesis. 



Create another image 
"(extractjori)' Lising~th^ixer 
values from theseJection. 



Create an internal palette from the ceramic table and apply the palette 
to the extraction using octree quantisation. 



For each pixel in the extraction determine a range key value using the 
following algorithm: 

the range key value consists of three elements: 

1. red component value divided by 16 

2. green component value divided by 1 6 

3. blue component value divided by 15 

(in the above the range key values are therefore: 

0 for con^ponent values 0-16 

1 for component values 16-31 

2 for component values 32-47 

. . . 3for component values 48-63- . . 

and so on) 



Swap the range key value with a vivid colour value which is readily 
identifiable by the eye, such as yellow, cyan, magenta etc. 



Enter information about this pixel into an Internal array of the following 
structure: 



Original 


Red 


Green 


B!ua 


Rang& 


Count of 


pixel 


Component 


Component 


Component 


Key 


PwelB in 


colour 








Value 


this range 



(For each pixel: It in the array, the range key value does not yet exist, 
a new element is created, however, if the range key value already 
exists, the count is increased by one.) 



In a duplicate image (contour) of the extraction, replace the 
corresponding pixel with one of the vivid colour. 



Once all pixels in the extraction have been processed, build an 
external table in an SQL compliant database of the same structure as 
the internal array and populate it with the contents of the internal array. 



Using stored SQL procedures in the database determine the dominant 
(most frequently occurring) original pixel value in each range key and 
create an internal array (key array), 



For each element in the key array draw a vivid colour rectangle as a 
key underneath the contour image and identify it with the shade 
relevant to thai key colour 
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